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WEB page for data retrieval, a data-type input function 
for a user to denote data type to be extracted from a 
selected block portion ( 179), and a search implementation 
function for implementing a search under the search 
system. The data type entered by the data input function 
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search implementation the block selected is searched for 
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Method and Apparatus for Retrieving Information From Semi-Structured, 

WEB-Based Data Sources 

5 

Field of the Invention 

The present invention is in the field of Internet navigation including various 
communication and connection technologies and pertains more particularly to 
10 methods and apparatus, including software, for obtaining information from semi- 
structured, WEB-based data sources for presentation to users. 



Cross-Reference to Related Documents 

15 

The present invention is a continuation in part to a patent application S/N 
09/323,598 entitled "Method and Apparatus for Obtaining and Presenting WEB 
Summaries to Users" filed on 06/01/99, which is a continuation in part (CIP) to a 
patent application S/N 09/208,740 entitled "Method and Apparatus for Providing 
20 and Maintaining a User-Interactive Portal System Accessible via Internet or other 
Switched-Packet-Network" filed on 12/08/98, disclosures of which are incorporated 
herein in their entirety herein by reference. 

25 Background of the Invention 

The information network known as the World Wide Web (WWW), which is a 
subset of the well-known Internet, is arguably the most complete source of publicly 
accessible information available. Anyone with a suitable Internet appliance such as a 
30 personal computer with a standard Internet connection may access (go on-line) and 
navigate to information pages (termed web pages) stored on Internet-connected 
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servers for the purpose of garnering information and initiating transactions with hosts 
of such servers and pages. 

Many companies offer various subscription services accessible via the 
Internet For example, many people now do their banking, stock trading, shopping, 
5 ! and so forth from the comfort of their own homes via Internet access. Typically, a 
user, through subscription, has access to personalized and secure WEB pages for such 
functions. By typing in a user name and a password or other personal identification 
code, a user may obtain information, initiate transactions, buy stock, and accomplish a 
myriad of other tasks. 

10 One problem that is encountered by an individual who has several or many 

such subscriptions to Internet-brokered services is that there are invariably many 
passwords and/or log-in codes to be used. Often a same password or code cannot be 
used for every service, as the password or code may already be taken by another user. 
A user may not wish to supply a code unique to the user such as perhaps a social 

15 security number because of security issues, including quality of security, that may 
vary from service to service. Additionally, many users at their own volition may 
choose different passwords for different sites so as to have increased security, which 
in fact also increases the number of passwords a user may have. 

Another issue that can plague a user who has many passworded subscriptions 

20 is the fact that they must bookmark many WEB pages in a computer cache so that 
they may quickly find and access the various services. For example, in order to 
reserve and pay for airline travel, a user must connect to the Internet, go to his/her 
book-marks file and select an airline page. The user then has to enter a user name and 
password, and follow on-screen instructions once the page is delivered. If the user 

25 wishes to purchase tickets from the WEB site, and wishes to transfer funds from an 
on-line banking service, the user must also look for and select the personal bank or 
account page to initiate a funds transfer for the tickets. Different user names and 
passwords may be required to access these other pages, and things get quite 
complicated. 
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Although this preceding example is merely exemplary, it is generally known 
that much work related to finding WEB pages, logging in with passwords, and the like 
is required to successfully do business on the WEB. 

A service known to the inventor and described in disclosure referenced by S/N 
5 09/208,740 listed under the cross-reference to related documents section provides a 
WEB service that allows a user to store all of his password protected pages in one 
location such that browsing and garnering information from them is much simplified. 
A feature of the above service allows a user to program certain tasks into the system 
such that requested tasks are executed by an agent (software) based on user 

10 instruction. The service stores user password and log-in information and uses the 
information to log-in to the user's sites, thus enabling the user to navigate without 
having to manually input log-in or password codes to gain access to the links. 

The above-described service uses a server to present a user-personalized 
application that may be displayed as an interactive home page that contains all of his 

15 listed sites (hyperlinks) for easy navigation. The application lists the user's URLs in 
the form of hyperlinks such that a user may click on a hyperlink and navigate to the 
page wherein login, if required, is automatic, and transparent to the user. 

The application described above also includes a software agent that may be 
programmed to perform scheduled tasks for the user including returning specific 

20 summaries and updates about user-account pages. A search function is provided and 
adapted to cooperate with the software agent to search user-entered URLs for specific 
content if such pages are cached somewhere in their presentable form such as at the 
portal server, or on the client's machine. 

A further enhancement to the system described above is known to the inventor 

25 and described in the disclosure of application S/N 09/323,598 also listed under the 
cross-reference section. The described enhancement consists of a means for obtaining 
information from WEB-based sources using a site-navigation script, a field template, 
and a means for parsing data. The navigation script follows site logic of a target WEB 
site containing the data for return to a user. Part of the template includes the 

30 description and location of the data requested by a user. A parsing engine acts to 



WO 01/71563 



-4- 



PCT/US01/08360 



identify the new data for retrieval for a user. In this way, WEB summaries may be 
compiled on updated data at user-frequented sites. 

There are certain limitations to the method described above in that an adequate 
description and location of the target data must be provided before the system may 
5 navigate to and parse the available data. The above system is designed to work with 
structured data wherein the target data appears in a same location or "field" time after 
time. Structured data is data that resides in a table, form, or other template format 
designed to contain the data. In some cases however, data is presented in a semi- 
structured fashion meaning that a desired chunk of data is not logically identifiable to 

10 a specific field, column, line, or table location wherein the data appears time after 

time. Identifying and retrieving information from semi-structured data sources can be 
extremely complicated. 

A good example of semi-structured data would be news headlines followed by 
summary text. There may be a differing number of headlines presented on a news 

15 page on any given day and the summaries under the headlines may take up variant 
space between headlines causing the headlines to appear in a consistently different 
location. Moreover, the summaries may be varied in format, style and so on. A news 
site containing headlines and summaries in list fashion represents a semi-structured 
site wherein data appears in different locations at different times. While a user may 

20 parse the entire page for data that matches a key word or phrase, the data is extracted 
out of context and may be meaningless to a user without the surrounding text. 

What is clearly needed is a method and apparatus that enables a user to request 
and receive information from semi-structured data sources. Such a system would 
provide effective summarization of data for user-visited sites wherein data does not 

25 follow a predictable structure or is fragmented over a significant portion of a WEB 
page. 

Summary of the Invention 

30 
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In a preferred embodiment of the present invention a configurable Internet 
WEB search system is provided, comprising a browser module for navigating to and 
displaying a WEB page; a block selection and configuration function having input 
tools for a user to select at least one block portion of a displayed WEB page for data 
5 retrieval; a data-type input function for a user to denote data type to be extracted from 
a selected block portion; and a search implementation function for implementing a 
search under the search system. The data type entered by the data input function is 
associated with a WEB page block selected, and upon search implementation the 
block selected is searched for the data type requested, and data found is retrieved to be 

10 provided to the user. 

In preferred embodiments block selection is by click and drag techniques as 
used in blocking text for a word processor, and data types are entered as natural 
language strings. Multiple blocks may be selected and a data-type associated with 
each selected block. In some embodiments search implementation may be initiated as 

15 each data block is selected and a data-type is associated with the selected data block, 
and matched data is immediately retrieved and transmitted to the user. In other 
embodiments matched data is retrieved and accumulated for a user until the user 
requests transmission of the accumulated data. 

In a preferred embodiment of the invention the search system is implemented 

20 between a user station and an Internet Portal server, the block selection and 

configuration function and the data-type input function executing on the user station, 
and navigation and data retrieval functions are executed by the Portal server. In these 
cases the user operates through a portal server to access and configure WEB pages, 
and the block selection and data-type association functions generate a data-type 

25 definition (DTD) file associated with the WEB page listing the selected blocks and 
associated data types for the page. The user in these cases has a home page on the 
portal server listing URLs visited regularly by the user, and wherein the system saves 
the DTD files created by the user for the user's regularly visited pages in a manner that 
the search system may be initiated by the user for selected pages from the home page, 

30 and when initiated, searches the selected pages according to the stored DTD for each 
page. 
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In another aspect of the invention a method for searching WEB pages by a 
user for specific data is provided, comprising steps of (a) navigating to a WEB page 
by the user via a browser function; (b) selecting a specific block of the WEB page by 
the user using a block selection and configuration function having input tools for a 
5 user to select at least one block portion of a displayed WEB page for data retrieval; (c) 
inputting a data type to be associated with a selected block using a data-type input 
function; (d) initiating a search; and (e) retrieving information from the data block 
according to the data type input. 

In preferred embodiments, in step (b), block selection is by click and drag 

10 techniques as used in blocking text for a word processor, and data types may be 

entered as natural language strings. Also, in some embodiments multiple blocks may 
be selected and a data-type associated with each selected block. In some cases search 
implementation is initiated as each data block is selected and a data-type is associated 
with the selected data block, and matched data is immediately retrieved and 

15 transmitted to the user, while in other cases matched data is retrieved and accumulated 
for a user until the user requests transmission of the accumulated data. 

In some preferred embodiments of the method the search system is 
implemented between a user station and an Internet Portal server, the block selection 
and configuration function and the data-type input function executing on the user 

20 station, and navigation and data retrieval functions are executed by the Portal server. 
In some of these embodiments wherein the user operates through a portal server to 
access and configure WEB pages, the block selection and data-type association 
functions generate a data-type definition (DTD) file associated with the WEB page 
listing the selected blocks and associated data types for the page. Also in many such 

25 cases the user has a home page on the portal server listing URLs visited regularly by 
the user, and wherein the system saves the DTD files created by the user for the user's 
regularly visited pages in a manner that the search system may be initiated by the user 
for selected pages from the home page, and when initiated, searches the selected pages 
according to the stored DTD for each page. 
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In embodiments of this invention described in enabling detail below, for the 
first time a fast and efficient system is provided for enabling a user/subscriber to 
retrieve data from semi-structured data sources. 

5 

Brief Description of the Drawing Figures 

Fig. 1 is an overview of an Internet portal system and network according to an 
embodiment of the present invention. 
10 Fig. 2 is an exemplary plan view of a personalized Portal home page 

application as it may be seen on a display monitor according to an embodiment of the 
present invention. 

Fig. 3 is a flow diagram illustrating user interaction with the Internet portal of 

fig. 1. 

15 Fig. 4 is a block diagram illustrating a summarization software agent and 

capabilities thereof according to an embodiment of the present invention. 

Fig. 5 is a logical flow chart illustrating an exemplary summarization process 
performed by the software agent of Fig. 4 operating in a user-defined mode. 

Fig. 6 is a logical flow chart illustrating an exemplary summarization process 
20 performed by the software agent of Fig. 4 in a User-independent smart mode with 
minimum user input. 

Fig. 7 is a block diagram illustrating a user-interactive template generation 
application according to an embodiment of the present invention. 

Fig. 8 is a block diagram illustrating intelligent parsing capability according to 
25 an embodiment of the present invention. 

Fig. 9 is a flow chart illustrating a semi-structured data retrieval process 
according to an embodiment of the present invention. 



30 
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According to a preferred embodiment of the present invention, a unique 
Internet portal is provided and adapted to provide unique services to users who have 
obtained access via an Internet or other network connection from an Internet-capable 
appliance. Such an interface provides users with a method for storing many personal 
5 WEB pages and further provides search function and certain task-performing 

functions. The methods and apparatus of the present invention are taught in enabling 
detail below. 

Fig. 1 is an overview of an Internet portal system 1 1 and Internet network 13 
according to an embodiment of the present invention. Portal system 1 1, in this 

10 embodiment, operates as an ISP in addition to a unique network portal, but may, in 
other embodiments be implemented as a stand-alone Internet server. In yet other 
embodiments the service and apparatus described herein may also be provided by 
such as a search and listing service (AltaVista™, Yahoo™) or by any other enterprise 
hosting a WEB-connected server. 

15 Internet 13 is representative of a preferred use of the present invention, but 

should not be considered limiting, as the invention could apply in other networks and 
combinations of networks. 

ISP 15 hi this embodiment comprises a server 31, a modem bank 33, 
represented here by a single modem, and a mass storage repository 29 for storing 

20 digital data. The modem bank is a convenience, as connection to the server could be 
by another type of network link. ISP 15, as is typical in the art, provides Internet 
access services for individual subscribers. In addition to well-known Internet access 
services, ISP 15 also provides a unique subscription service as an Internet portal for 
the purpose of storing many WEB pages or destinations along with any passwords and 

25 or personal codes associated with those pages, in a manner described in more detail 
below. This unique portal service is provided by execution of Portal Software 35, 
which is termed by the inventors the Password- All suite. The software of the 
invention is referred to herein both as the Portal Software, and as the Password-all 
software suite. Also, in much of the description below, the apparatus of the invention 

30 is referred to by the Password- All terminology, such as the Password-All Server or 
Password-All Portal. 
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ISP 15 is connected to Internet 13 as shown. Other equipment known in the 
art to be present and connected to a network such as Internet 13, for example, IP data 
routers, data switches, gateway routers, and the like, are not illustrated here but may 
be assumed to be present. Access to ISP 15 is through a connection-oriented 

5 telephone system as is known in the art, or through any other Intemet/WEB access 
connection, such as through a cable modem, special network connection (e.g. Tl), 
ISDN, and so forth. Such connection is illustrated via access line 19 from Internet 
appliance 17 through modem bank 33. 

In a preferred embodiment a user has access to Internet Password- All Portal 

10 services by a user name and password as is well known in the art, which provides an 
individualized WEB page to the subscriber. In another embodiment wherein a user 
has other individuals that use his or her Internet account, then an additional password 
or code unique to the user may be required before access to portal 3 1 is granted. Such 
personalized Portal WEB pages may be stored in repository 29, which may be any 

15 convenient form of mass storage. 

Three Internet servers 23, 25, and 27, are shown in Internet 13, and represent 
Internet servers hosted by various enterprises and subscribed to by a user operating 
appliance 17. For example, server 23 may be a bank server wherein interactive on- 
line banking and account managing may be performed. Server 25 may be an 

20 investment server wherein investment accounts may be created and managed. Server 
27 may be an airline or travel server wherein flights may be booked, tickets may be 
purchased, and so on. In this example, all three servers are secure servers requiring 
user ID and password for access, but the invention is not necessarily limited to just 
secure services. 

25 In a preferred embodiment of the present invention, a subscribing user 

operating an Internet-capable appliance, such as appliance 17, connects to Password- 
All Portal system 1 1 hosted by ISP 15, and thereby gains access to a personalized, 
interactive WEB page, which in turn provides access to any one of a number of 
servers on Internet 13 such as servers 23, 25, and 27, without being required to enter 

30 additional passwords or codes. In a preferred embodiment the software that enables 
this service is termed Password-All by the inventors. Password-All may be 
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considered to be a software suite executing on the unique server, and in some 
instances also on the user's station (client). Additional interactivity provided by portal 
software 35 allows a connected user to search his listed pages for information 
associated with keywords, text strings, or the like, and allows a user to program user- 
5 defined tasks involving access and interaction with one or more Internet-connected 
servers such as servers 23, 25, and 27 according to a pre-defined time schedule. 
These functions are taught in enabling detail below. 

Fig. 2 is an illustration of a personalized portal page as may be seen on a 
display monitor according to an embodiment of the present invention, provided by 

10 Password- All Portal software 35 executing on server 31, in response to secure access 
by a subscriber. Page 32 presents an interactive listing 34 of user-subscribed or 
member WEB pages, identified in this example by URL, but which may also be 
identified by any convenient pseudonym, preferably descriptive, along with user name 
and typically encrypted password information for each page. Listed in a first column 

15 under destination, are exemplary destinations LBC.com, My Bank.com, My 

Stocks.com, My shopping.com, Mortgage.com, and Airline.com. These are but a few 
of many exemplary destinations that may be present and listed as such on page 33. In 
order to view additional listings listed but not immediately viewable from within 
application 33, a scroll bar 35 is provided and adapted to allow a user to scroll up or 

20 down the list to enable viewing as is known in the art. 

Items listed in list 34 in this example may be considered destinations on such 
as servers 23, 25, and 27 of Fig. 1. Typically the URL associated with an item on this 
list will not take a user to a server, per se, but to a page stored on a server. User 
names and password data associated with each item in list 34 are illustrated in 

25 respective columns labeled user name, and password, to the right of the column 
labeled destination. Each listing, or at least a portion of each listing, is a hyperlink 
invoking, when selected, the URL to that destination. In some instances a particular 
service may have more than one associated URL. For example, My Bank.com may 
have more than one URL associated for such as different accounts or businesses 

30 associated also with a single subscriber. In this case there may be a sub-listing for 
different destinations associated with a single higher-level listing. This expedient is 
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not shown, but given this teaching the mechanism will be apparent to those with skill 
in the art. 

In some embodiments one page 33 may be shared by more than one user, such 
as a husband and wife sharing a common account and subscription. An instance of 
5 this is illustrated herein with respect to the server labeled Mortgage.com wherein both 
a John and a Jane Doe are listed together under the column labeled user name. In 
another embodiment, a network of individuals, perhaps business owners, authorized 
co-workers, investment parties, or the like may share one application. In this way, 
system 1 1 may be adapted for private individuals as well as business uses. 

10 After gaining access to application 33 which is served via Internet portal 

server 31 of Fig. 1, a user may scroll, highlight, and select any URL in his or her list 
34 for the purpose of navigation to that particular destination for further interaction. 
Application 33 already has each password and user name listed for each URL. It is 
not necessary, however, that the password and user name be displayed for a user or 

15 users. These may well be stored transparently in a user f s profile, and invoked as 
needed as a user makes selections. Therefore, a user is spared the need of entering 
passwords and user names for any destinations enabled by list 34. Of course, each list 
34 is built, configured and maintained by a subscribing user or users, and an editing 
facility is also provided wherein a user may edit and update listings, including 

20 changing URLs adding and deleting listings, and the like. 

In another aspect of the invention new listings for a user's profile, such as a 
new passthrough to a bank or other enterprise page, may be added semi-automatically 
as follows: Typically, when a user opens a new account with an enterprise through 
interaction with a WEB page hosted by the enterprise, the user is required to provide 

25 certain information, which will typically include such as the user's ID, address, e-mail 
account, and so forth, and typically a new user name and password to access the 
account. In this process the user will be interacting with the enterprise's page from 
his/her browser. A Password- All plug-in is provided wherein, after entering the 
required information for the new enterprise, the user may activate a pre-determined 

30 signal (right click, key stroke, etc.), and the Password- All suite will then enter a new 
passthrough in the user's Password. All profile at the Password- All Portal server. 
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In a related method for new entries, the enterprise hosting the Password- All 
. Portal may, by agreement with other enterprises, provide log-in and sign-up services 
at the Password-All Portal, with most action transparent to the user. For example, 
there may be, at the Password- All Portal, a selectable browser list of cooperating 

5 enterprises, such as banks, security services, and the like, and a user having a 
Password- All Portal subscription and profile may select among such cooperating 
enterprises and open new accounts, which will simultaneously and automatically be 
added to the Password- All Portal page for the user and to the server hosted by the 
cooperating enterprise. There may be some interactivity required for different 

10 accounts, but in the main, much information from the user's profile may be used 
directly without being re-entered. 

The inventors have anticipated that many potential users may well be 
suspicious of providing passwords and user names to an enterprise hosting a 
Pass word- All Portal Server executing a service like Pass word- All according to 

15 embodiments of the present invention. To accommodate this problem, in preferred 
embodiments, it is not necessary that the user provide the cleartext password to 
Password. All. Instead, an encrypted version of each password is provided. When a 
user links to his passthrough page in Password- All at the Password- All Portal server, 
when he/she invokes a hyperlink, the encrypted password is returned to the user's 

20 system, which then, by virtue of the kept encryption key or master password, invokes 
the true and necessary password for connection to the selected destination. It is thus 
not necessary that cleartext passwords be stored at the Password- All Portal server, 
where they may be vulnerable to attack from outside sources, or to perceived misuse 
in other ways as well. 

25 In a related safety measure, in a preferred embodiment of the invention, a 

user's complete profile is never stored on a single server, but is distributed over two or 
more, preferably more, servers, so any problem with any one server will minimize the 
overall effect for any particular user. 

Password- All, as described above, allows a user to access a complete list of 

30 the user's usual cyberspace destinations, complete with necessary log-on data, stored 
in an encrypted fashion, so a user may simply select a destination (a hyperlink) in the 
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Password-AU list, and the user's browser then invokes the URL for the selected 
destination. In an added feature, Password- All may display banner ads and other 
types of advertisement during the navigation time between a hyperlink being invoked 
and the time the destination WEB page is displayed. 
5 In yet another embodiment of the invention, a user/subscriber need not access 

the Password- All page to enjoy the advantages of the unique features provided. In 
this variation, a Plug-In is provided for the subscriber's WEB browser. If the 
subscriber navigates by use of the local browser to a WEB page requiring a secure 
log-in, such as his/her on-line banking destination, when the subscriber is presented 

10 with an input window for ID and Password, the plug in may be activated by a 

predetermined user input, such as a hot key or right click of the mouse device. The 
plug-in then accesses, transparently, the Password- All page (which may be cached at 
the client), and automatically accesses and provides the needed data for log-on. 
In yet another aspect of the invention a search option 37 allows a user to 

15 search list 34 for specific URLs based on typed input such as keywords or the like. In 
some cases, the number of URLs stored in list 34 can be extensive making a search 
function such as function 37 an attractive option. A criteria dialog box 51 illustrated 
as logically separated from and below list 34 is provided and adapted to accept input 
for search option 37 as is known in the art. In one embodiment, search option 37 may 

20 bring up a second window wherein a dialog box such as box 5 1 could be located. 

In another aspect of the invention the search function may also be configured 
in a window invoked from window 33, and caused to search all or selected ones of 
listed destinations, and to return results in a manner that may be, at least to some 
extent, configured by a user. For example, a dialog box may be presented wherein a 

25 user may enter a search criteria, and select among all of the listed destinations. The 
search will then be access each of the selected destinations in turn, and the result may 
be presented to the user as each instance of the criteria is found, or results may be 
listed in a manner to be accessed after the search. 

Preferably the search function is a part of the Password- All Portal software, 

30 available for all users, and may be accessed by hyperlinks in user's personal pages. In 



WO 01/71563 



-14- 



PCT/US01/08360 



some embodiments users may create highly individualized search functions that may 
be stored in a manner to be usable only by the user who creates such a function. 

In many aspects of the present invention, knowledge of specific WEB pages, 
and certain types of WEB pages, is highly desirable. In many embodiments 

5 characteristics of destination WEB pages are researched by persons (facilitators) 

maintaining and enhancing Password-All Portal software 35, and many characteristics 
may be provided in configuration modules for users to accomplish specific tasks. In 
most cases these characteristics are invoked and incorporated transparent to the user. 
In yet another aspect of the present invention, the Password- All suite is 

10 structured to provide periodic reports to a user, in a manner to be structured and timed 
by the user, through the user's profile. For example, reports of changes in account 
balances in bank accounts, stock purchases, stock values, total airline travel purchases, 
frequent-flier miles, and the like may be summarized and provided to the users in 
many different ways. Because the Password- All Portal server with the Pass word- All 

15 software site handles a broad variety of transactional traffic for a user, there is an 
opportunity to summarize and collect and process statistics in many useful ways. In 
preferred embodiments of the invention such reports may be furnished and 
implemented in a number of different ways, including being displayed on the user's 
secure personal WEB page on the Password-All Portal. 

20 In addition to the ability of performing tasks as described above, task results 

including reports, and hard documents such as airline tickets may be sent over the 
Internet or other data packet-networks to user-defined destinations such as fax 
machines, connected computer nodes, e-mail servers, and other Internet-connected 
appliances. All tasks may be set-up and caused to run according to user-defined 

25 schedules while the user is doing something else or is otherwise not engaged with the 
scheduled task. 

In another embodiment of the present invention, recognizing the increasing 
use of the Internet for fiscal transactions, such as purchasing goods and services, a 
facility is provided in a user's profile to automatically track transactions made at 
30 various destinations, and to authorize payment either on a transaction-by-transaction 
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basis, or after a session, using access to the user's bank accounts, all of which may be 
pre-programmed and authorized by the user. 

Other functions or options illustrated as part of application 35 include a last 
URL option 41, an update function 43, and an add function 45. Function 41 allows a 
5 user to immediately navigate to a last visited URL. Update function 43 provides a 
means of updating URLs for content and new address. An add function enables a user 
to add additional URLs to list 34. Similarly, function 45 may also provide a means to 
delete entries. Other ways to add accounts are described above. It should be noted 
that the services provided by the unique Password- All Portal in embodiments of the 

10 present invention, and by the Password- All software suite are not limited to 
destinations requiring passwords and user names. The Password- All Portal and 
software in many embodiments may also be used to manage all of a user's bookmarks, 
including editing of bookmarks and the like. In this aspect, bookmarks will typically 
be presented in indexed, grouped, and hierarchical ways. 

15 There are editing features provided with Pass word- All for adding, acquiring, 

deleting, and otherwise managing bookmarks. As a convenience, in many 
embodiments of the invention, bookmarks may be downloaded from a user's 
Password-All site, and loaded onto the same user's local browser. In this manner, 
additions and improvements in the bookmark set for a user may be used without the 

20 necessity of going to Password- All. Further, bookmarks may be uploaded from a 
user's local PC to his/her home page on the Password- All site by use of one or more 
Password- All plug-ins. 

It will be apparent to the skilled artisan, given the teaching herein, that the 
functionality provided in various embodiments of the invention is especially 

25 applicable to Internet-capable appliances that may be limited in input capability. For 
example, a set-top box in a WEB TV application may well be without a keyboard for 
entering IDs and Passwords and the like. In practice of the present invention 
keyboard entry is minimized or eliminated. The same comments apply to many other 
sorts of Internet appliances. 

30 In preferred embodiments of the invention, once a subscriber-user is in 

Password- All, only an ability to point-and-click is needed for all navigation. To get 
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into the Password- All site, vising a limited apparatus, such as an appliance without a 
keyboard or keypad, a Smartcard or embedded password may be used, or some other 
type of authentication. 

It will be apparent to one with skill in the art that an interactive application 
5 such as application 33 may be provided in a form other than a WEB page without 
departing from the spirit and scope of the present invention. For example, an 
application such as application 33 may be provided as a downloadable module or 
program that may be set-up and configured off-line and made operational when on- 
line. 

10 Fig. 3 is a flow diagram illustrating user interaction with the Internet 

Password- All Portal of fig. 1. The following process steps illustrated, according to an 
embodiment of the present invention, are intended to illustrate exemplary user-steps 
and automated software processes that may be initiated and invoked during interaction 
with an Internet portal of the present invention such as portal 31 of Fig. 1. In step 53 

15 a user connects to the Internet or another previously described switched-packet 
network via a compatible appliance such as Internet appliance 17 of Fig. 1. 

At step 55, a user enters a user-name and password, which, in one 
embodiment, may simply be his ISP user name and password. In another 
embodiment, a second password or code would be required to access an Internet 

20 portal such as portal server 3 1 of Fig. 1 after logging onto the Internet through the 
ISP. In some cases, having a special arrangement with the ISP, there may be one 
password for both Internet access through the ISP and for Password-All. At step 57 a 
personal WEB page such as page 32 of Fig. 2 is displayed via Internet portal server 
3 1 . At minimum, the personalized WEB page will contain all user configured URLs, 

25 and may also be enhanced by a search function, among other possibilities. 

In step 58 a user will, minimally, select a URL from his or her bookmarked 
destinations, and as is known by hyperlink technology, the transparent URL will be 
invoked, and the user will navigate to that destination for the purpose of normal user 
interaction. In this action, the Password- All Portal software transparently logs the 

30 user on to the destination page, if such log-on is needed. 
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At step 60 the user invokes a search engine by clicking on an option such as 
described option 37 of Fig. 2. At step 62, the user inputs search parameters into a 
provided text field such as text field 51 of Fig. 2. After inputting such parameters, the 
user starts the search by a button such as button 52. The search engine extracts 
5 information in step 64. Such information may be, in one option, of the form of URLs 
fitting the description provided by search parameters. A searched list of URLs may 
be presented in a separate generated page in step 66 after which a user may select 
which URL to navigate to. In an optional search function, the user may provide 
search criteria, and search any or all of the possible destinations for the criteria. 

10 In another embodiment wherein WEB pages are cached in their presentable 

form, information extracted in step 64 may include any information contained in any 
of the stored pages such as text, pictures, interactive content, or the like. In this case, 
one displayed result page may provide generated links to search results that include 
the URL associated with the results. Perhaps by clicking on a text or graphic result, 

15 the associated WEB page will be displayed for the user with the result highlighted and 
in view with regards to the display window. 

Enhanced Agent for WEB Summaries 

20 In another aspect of the present invention, a software agent, termed a gatherer 

by the inventors, is adapted to gather and return summary information about URLs 
according to user request or enterprise discretion. This is accomplished in 
embodiments of the present invention by a unique scripting and language parsing 
method provided by the inventor wherein human knowledge workers associated with 

25 the service provide written scripts to such a gatherer according to subscriber or 

enterprise directives. Such a software gatherer, and capabilities thereof, is described 
in enabling detail below. 

Referring now to Fig. 1, there is illustrated an exemplary architecture 
representing a portal service-network which, in this case is hosted by ISP 15. Portal 

30 software 35 in this embodiment executes on portal server 3 1 set-up at the ISP 
location. Mass repository 29 is used for storing subscriber information such as 
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passwords, login names, and the like. Internet servers 23, 25, and 27 represent servers 
that are adapted to serve WEB pages of enterprises patronized by a subscriber to the 
portal service such as one operating Internet appliance 17. 

The main purpose of portal software 35 as described above with reference to 
5 Fig. 2, is to provide an interactive application that lists all of the subscriber's WEB 
sites in the form of hyperlinks. When a user invokes a hyperlink from his personal 
list, software 35 uses the subscriber's personal information to provide an automatic 
and transparent login function for the subscriber while jumping the subscriber to the 
subject destination. 

10 Referring again to Fig. 2, an interactive list 34 containing user-entered 

hyperlinks and a set of interactive tools is displayed to a subscriber by portal software 
35 of Fig. 1. One of the tools available to a subscriber interacting with list 34 is agent 
(software) 39. Agent 39 may be programmed to perform certain tasks such as 
obtaining account information, executing simple transactions, returning user- 

15 requested notification information about upcoming events, and so on. Search function 
37 and update function 43 may be integrated with agent 39 as required to aid in 
functionality. 

It is described in the above disclosure that agent 39 may, in some 
embodiments, search for and return certain summary information contained on user- 
20 subscribed WEB pages, such as account summaries, order tracking information and 
certain other information according to user-defined parameters. This feature may be 
programmed by a user to work on a periodic time schedule, or on demand. 

In the following disclosure, enhancements are provided to agent 39. Such 
enhancements, described in detail below, may be integrated into agent 39 of portal 
25 software 35 (Fig.'s 1 and 2); and may be provided as a separate agent or gatherer to 
run with portal software 35; or may, in some embodiments, be provided as a 
standalone service that is separate from portal software 35. 

Fig. 4 is a block diagram illustrating a summarization software agent 67 and 
various capabilities and layers thereof according to an embodiment of the present 
30 invention. Summarization agent 67, hereinafter termed gatherer 67, is a 

programmable and interactive software application adapted to run on a network 



WO 01/71563 



PCT/US01/08360 



-19- 

server. Gatherer 67 may, in one embodiment, be integrated with portal software 35 of 
Fig. 1 and be provided in the form of a software module separate from agent 39 (Fig. 
2). In another embodiment, gatherer 67 may be a part of agent 39 as an enhancement 
to the function of that agent as previously described. In still another embodiment, 

5 gatherer 67 may be provided as a parent or client-side application controlled by a 
separate service from the portal service described above. 

In this exemplary embodiment gatherer 67 is a multi-featured software 
application having a variety of sub-modules and interface modules incorporated 
therein to provide enhanced function. Gatherer 67 has a client/service interface layer 

10 69 adapted to enable directive input from both a client (user) and a knowledge worker 
or workers associated with the service. A browser interface 77 is provided in layer 69, 
and adapted to provide access to application 67 from a browser running on a client's 
PC or other Internet or network appliance. Interface 77 facilitates bi-directional 
communication with a user's browser application (not shown) for the purpose of 

15 allowing the user to input summary requests into gatherer 67 and receive summary 
results. Interface 77 supports all existing network communication protocols such as 
may be known in the art, and may be adapted to support future protocols. 

Layer 69 also comprises a unique input scripting module 79 that is adapted to 
allow a human knowledge worker to create and supply directive scripts containing the 

20 site logic needed by gatherer 67 to find and retrieve data from a WEB site. In this 
case, gatherer 67 executes and runs on a network server such as server 31 of Fig. L 
However, this is not required in order to practice the present invention. 

It is assumed in this example that gatherer 67 is part of the portal software 
suite 35 running on server 31 of Fig. 1. Gatherer 67 may be provided as several 

25 dedicated agents, or as one multi-functional agent without departing from the spirit 
and scope of the present invention. For example, one gatherer 67 may be scripted and 
programmed to execute a single user request with additional gatherers 67 called upon 
to perform additional user-requests. Alternatively, one gatherer 67 may be dedicated 
and assigned to each individual user and adapted to handle all requests from that user. 

30 Interface layer 69 facilitates exchange of information from both a client and a 

knowledge worker. A client operating a WEB browser with an appropriate plug-in is 
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enabled to communicate and interact with gatherer 67. For example, a user may enter 
a request to return a summary of pricing for all apartments renting for under $1000.00 
per month located in a given area (defined by the user) from apartments.com (one of 
user's registered WEB sites). The just mentioned request would be categorized as 
5 either a periodic request, or a one time (on demand) request. The communicated 
request initiates a service action wherein a knowledge worker associated with the 
service uses module 79 to set-up gatherer 67 to perform it's function. Module 79 is 
typically executed from a network-connected PC operated by the knowledge worker. 
According to an embodiment of the present invention, a unique scripting 

10 method facilitated by module 79 is provided to enable gatherer 67 to obtain the goal 
information requested by a user. For example, the above mentioned example of 
WEB-site apartments.com has a specific HTML (hyper-text-markup-language) logic 
that it uses to create its site and post its information. Such site logic is relatively 
standard fare for a majority of different sites hosted by different entities. Using this 

15 knowledge, a knowledge worker creates a site-specific script or template for gatherer 
67 to follow. Such a template contains descriptions and locations of the appropriate 
fields used, for example, at apartments.com. Apartment description, location, deposit 
information, rental information, agent contact information, and other related fields are 
matched in terms of location and label description on the template created with 

20 module 79. Completed templates are stored in a database contained in a storage 
facility such as, perhaps, repository 29 of Fig. 1. Such templates may be reused and 
may be updated (edited) with new data. 

In one embodiment, one script may contain site logics for a plurality of WEB 
pages, and instructions for specific navigational instruction and password or login 

25 information may be contained therein and executed serially, such as one site at a time. 
It is important to note that the knowledge worker or workers may perform much of 
their scripting via automatic controls such as by object linking and embedding (OLE) 
and a minor portion of scripting may be performed manually in an appropriate 
computer language, many of which are known in the art). 

30 Gatherer 67 also has a process layer 71 adapted for internal information 

gathering and parameter configuration. An optional portal server interface 81 is 
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provided and adapted to allow gather 67 to provide updated information to a user's list 
of hyperlinks and also to obtain data from portal server 3 1 if required. For example, 
required hyperlinks may be mirrored from a user's home page to a scripting template 
for navigational purposes. In an embodiment wherein gatherer 67 is part of a 
5 standalone service, a convention for providing user login information may be supplied 
at the client's end when a request is made. For example, an encrypted password may 
be supplied by a client plug-in and gatherer 67 may temporarily borrow the user's 
encryption key when auto login is performed. 

An appliance configuration module 83 is provided and adapted to allow a user 

10 to define and configure an Internet appliance to communicate with the service and 
receive summary information. Such appliances may include but are not limited to 
palm top PC's, lap top PC's, cellular telephones, WEB TV's, and so on. Typically, a 
user will be presented a configuration WEB page from a network server that displays 
in his browser window on his desktop PC. The page contains an interface for 

15 communicating device parameters and communication protocol types to module 83. 
In this way, a user may configure a preferred device for receipt of summary 
information. Device parameters and communication protocols inherent to such a 
device are incorporated into the scripting of the site template and are used as 
instructions for WEB summary delivery. 

20 A navigation layer 73 is provided and adapted to perform the function of 

external site navigation and data gathering for gatherer 67. To this end, a 
communication interface/browser control module 85 is provided and adapted to 
function as a WEB browser to access WEB sites containing WEB data. Control 85 
receives it's instruction from the scripted template created by the knowledge worker. 

25 A parsing engine 87 is provided and adapted to parse individual WEB sites 

according to a template created via scripting module 79. Parsing engine 87 may be a 
Pearl engine, an IE HTML engine, or any other or combination of known parsing 
engines. The template (not shown) tells control 85 and parsing engine 87 where to go 
and what fields at the destination site to look for to access desired data. Once the data 

30 fields are located, parsing engine 87 gathers current data in the appropriate field, and 
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returns that data to the service for further processing such as data conversion, 
compression and storage, and the like. 

Because WEB sites use tools that use consistent logic in setting up their sites, 
this logic may be used by the summarization service to instruct control 83 and parsing 
5 engine 87. The inventor provides herein an exemplary script logic for navigating to 
and garnishing data from amazon™.com. The hyperlinks and/or actual URLs 
required for navigation are not shown, but may be assumed to be included in the 
template script. In this example, a company name Yodlee (known to the inventors) is 
used in the script for naming object holders and object containers, which are in this 
10 case Active X™ conventions. In another embodiment, Java™ script or another object 
linking control may be used. The scripted template logic example is as follows: 
# Site amazon.orders.x - shows status of orders from Amazon 

login( 7 ); 

15 

get( "/exec/obidos/order-list/" ); 

my @tables = get_tables_containing_text( "Orders:" ); 

20 my Sorderjist = new Yodlee: :ObjectHolder( 'orders' ); 
$order_list->source( 'amazon 1 ); 
$order_list->link_info( get_link_info() ); 

my @href_list; 
25 my @container_list; 

foreach my Stable ( @tables ) { 

my @rows = get_table_rows(); 

30 foreach my $i ( 0 .. $#rows ) { 
select_row( $i ); 

my $text = get_text( $rows[ $i ] ); 
next if $text =~ /Orders:|Status/; 

35 my @items = get_rowJtems(); 

next unless @items >= 4; 

my( $orderjium, $date, $status ); 
select_cell( 1 ); 
40 $orderjium = get_cell_text0; 



WO 01/71563 PCT/US01/08360 

-23- 

my $href = get_url_of_firstJaref( get_cell() ); 

select_cell( 2 ); 
$date = get_cell_textO; 
5 select_cell( 3 ); 

$status = get_cell_text(); 

next unless defined $order_num and defined $date and defined Sstatus; 

1 0 my $order = new Yodlee: : Container( 'orders' ); 

$order->orderjiumber( Sorderjium ); 
$order->date( $date ); 
$order->status( Sstatus ); 

1 5 $order_list->push_object( $order ); 

if( defined $href) { 
push( @href_list, $href ); 
push( @container_list, $order ); 

20 foreach my $i ( 0 $#href_list ) { 
get( $hrefjist[ $i ] ); 

©tables = get_tables_containing_text( "Items Ordered:" ); 

25 

foreach my Stable ( ©tables ) { 

my @rows = get_toblejrows(); 

foreach my $j ( 0 .. $#rows ) { 
30 select_row( $j ); 

my $href = get_url_ofjTirstJiref( getjrowO ); 

next unless defined $href; 

my @child_list = get_children( get_row(), ' af ); 
next unless defined $child_list[ 0 ]; 

my $text = get _text( $child_list[ 0 ] ); 

$container_list[ $i ]->description( $text ); 



35 



40 



45 



} 
} 

} 

result( $order_list ); 
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The above example is a script that instructs control 85 and parser 87 to 
navigate to and obtain data from Amazon™.com, specifically that data that reflects 
the user's current order status. Scripts may also be written to obtain virtually any type 
5 of text information available from any site. For example, a user may wish to obtain 
the New York Times headlines, the top ten performing stocks, a comparative list of 
Ilights from San Francisco to New York, etc. In one embodiment, metadata may be 
associated with and used in-place of the actual scripted language for the purpose of 
reducing complication in the case of many scripts on one template. 

10 A data processing layer 75 is provided and adapted to store, process, and 

present returned data to users according to enterprise rules and client direction. A 
database interface module 89 is provided and adapted to provide access for gatherer 
67 to a mass repository such as repository 29 of Fig. 1, for the purpose of storing and 
retrieving summary data, templates, presentation directives, and so on. Gatherer agent 

15 67 may also access data through interface 89 such as profile information, user account 
and URL information, stored site logics and so on. Data scanned from the WEB is 
stored in a canonical format in a database such as repository 29, or in another 
connected storage facility. All stored data is, of course, associated with an individual 
who requested it, or for whom the data is made available according to enterprise 

20 discretion. 

A summarization page module 91 is provided and adapted to organize and 
serve a WEB summary page to a user. Module 91, in some embodiments, may 
immediately push a WEB summary to a user, or module 91 may store such 
summarized pages for a user to access via a pull method, in which case a notification 

25 may be sent to the user alerting him of the summary page availability. Summarization 
module 91 includes an HTML renderer that is able to format data into HTML format 
for WEB page display. In this way, e-mail messages and the like may be presented as 
HTML text on a user's summarization page. Moreover, any summary data from any 
site may include an embedded hyperlink to that site. In this way, a user looking at an 

30 e-mail text in HTML may click on it and launch the appropriate e-mail program. 
Other sites will, by default, be linked through the summary page. 
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Many users will access their summary data through a WEB page as described 
above, however, this is not required in order to practice the present invention. In 
some embodiments, users will want their summary information formatted and 
delivered to one of a variety of Internet-capable appliances such as a palm top or, 
5 perhaps a cell phone. To this end, the Tenderer is capable of formatting and presenting 
the summary data into a number of formats specific to alternative devices. Examples 
of different known formats include, but are not limited to XML, plain text, VoxML, 
HDML, audio, video, and so on. 

In a preferred embodiment of the present invention, gather 67 is flexible in 

10 such a way as it may act according to enterprise rules, client directives, or a 

combination of the two. For example, if a user makes a request for summary data 
about a user/subscribed WEB page to be periodically executed and presented in the 
form of a HTML document, then gather 67 would automatically access and analyze 
the required internal information and user provided information to formulate a 

15 directive. Using scripting module 79, a knowledge worker provides a template (if one 
is not already created for that site) that contains the "where to go" and "what to get" 
information according to site logic, user input, and known information. 

Alternatively, if a user requests a summary about data on one of his sites such 
as, perhaps, current interest rates and re-finance costs at his mortgage site, the service 

20 may at it's own discretion provide an additional unsolicited summary from an 
alternate mortgage site for comparison. This type of summarization would be 
designed to enhance a user's position based on his profile information. In this case, 
updated data about latest interest rates, stock performances, car prices, airline ticket 
discounts, and so on would be stored by the service for comparative purposes. If a 

25 user request for a summary can be equaled or bettered in terms of any advantage to 
the user, such summary data may be included. 

In many cases, created templates may be re-used unless a WEB site changes 
it's site logic parameters, in which case, the new logic must be accessed and any 
existing templates must be updated, or a new template may be created for the site. 

30 The templates contain site-specific script obtained from the site and stored by the 
knowledge workers. In one embodiment, companies hosting WEB pages 



WO 01/71563 PCT/US01/08360 

-26- 

automatically provide their site logics and any logic updates to the service by virtue of 
an agreement between the service and the WEB hosts. 

In an alternative embodiment gatherer 67 may be implemented as a client 
application installed on a user's PC. In this embodiment, a user would not be required 
5 to supply log-in or password codes. Summarization scripts may be sent to the client 
software and templates may be automatically created with the appropriate scripts 
using log-in and password information encrypted and stored locally on the user's 
machine. 

In addition to providing WEB summary information, gatherer 67 may also be 

10 used to provide such as automatic registration to new sites, and for updating old 

registration information to existing sites. For example, if a user whishes to subscribe, 
or register at a new site, only the identification of the site is required from the user as 
long as his pertinent information has not changed. If a new password or the like is 
required, gatherer 67 through control module 73 may present login or password codes 

15 from a list of alternative codes provided by a user. In another embodiment, a database 
(not shown) containing a wealth of password options may be accessed by gatherer 67 
for the purpose of trying different passwords until one is accepted by the site. Once a 
password or log-in code is accepted, it may be sent to a user and stored in his 
password list and at the network level. 

20 It will be apparent to one with skill in the art that a software application such 

as gatherer 67 may be implemented in many separate locations connected in a data 
network. For example, a plurality of gatherer applications may be distributed over 
many separate servers linked to one or more mass repositories. Client applications 
include but are not limited to a WEB-browser plug-in for communicating to the 

25 service. Plug-in extensions may also be afforded to proxy servers so that auto-login 
and data access may still be performed transparent to a user. 

In another embodiment, plug-ins enabling communication with gatherer 67 
may be provided and configured to run on other network devices for the purpose of 
enabling such a device to initiate a request and get a response without the need for a 

30 desktop computer. 
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In most embodiments a user operating a desktop PC will order a one time or 
periodic summary related to some or all of his subscribed WEB sites. A logical flow 
of an exemplary request/response interaction is provided below. 

Fig. 5 is a logical flow chart illustrating an exemplary summarization process 
5 performed by the software agent of Fig. 4 operating in a user-defined mode. In step 
93, a user has initiated a new request for a summary (summary order). It is assumed 
for the purpose of discussion, that the request of step 93 involves a site wherein no 
template has been created. In step 95, the request is received and analyzed. A 
knowledge worker will likely perform this step. The new request may be posted to 

10 the user's portal home page, sent directly to gatherer 67, or even communicated 
through e-mail or other media to the service. 

In step 97 a knowledge worker accesses particular site logic associated with 
the request URLs. For example, if the request involves a plurality of URLs, then all 
site logics for those URLs are accessed. Logic may be available in a repository such 

15 as repository 29 of Fig. 1 if they were obtained at the time of user registration to a 
particular URL, or sent in by WEB-site hosts shortly after registration. If it is a 
completely new URL, then the logic must be obtained from the site. In most cases 
however, the logic will be known by virtue of a plurality of users accessing common 
URLs. Therefore cross-linking in a database of logic/user associations may be 

20 performed to access a logic for a site that is new to one particular user, but not new to 
another. 

In step 99, the knowledge worker creates a template by virtue of scripting 
module 79 (Fig. 4) containing all site logic, URLs, log-in and password information, 
and the user request information. As described previously, templates may be re-used 

25 for a same request. In most cases, scripting may be mostly automated with minimum 
manual input performed by the knowledge worker. In many cases, an existing 
template will match a new request exactly, and may be re-used. In that case steps 97, 
99, and 101 would not be required. 

In step 101 the template is stored and associated with the requesting user. The 

30 stored template may now be retrieved at a scheduled time for performing the summary 
gathering. At step 103, a browser control such as module 85 of Fig. 4 is activated to 
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access the stored template and navigate to specified URLs for the purpose of gathering 
summary data. If a timing function is attributed to the template stored in step 101, 
then the template may self execute and call up the browser function. In another 
embodiment, the knowledge worker may notify the browser control to get the 

5 template for it's next task. In some embodiments, a plurality of controls may be used 
with one template as previously described. 

In step 105, automatic log-in is performed, if required, to gain access to each 
specified URL. In step 107, a specified WEB page is navigated to and parsed for 
requested data according to the logic on the template. If there are a plurality of WEB 

10 -pages to parse, then this step is repeated for the number of pages. A variety of 
parsing engines may be used for this process such as an IE™ parser, or a Pearl™ 
parser. Only the requested data is kept in step 107. 

A request may be an on-demand request requiring immediate return, or a 
scheduled request wherein data may be posted. At step 109, such logic is confirmed. 

15 If the data is to be presented according to a periodic schedule, then summary data 

parsed in step 107 is stored for latter use in step 111. In step 113, the summary data is 
rendered as HTML if not already formatted, and displayed in the form of a summary 
WEB page in step 115. The summary page may be posted for access by a user at a 
time convenient to the user (pull), or may be pushed as a WEB page to the user and be 

20 made to automatically display on the user's PC. Notification of summary page 
availability may also be sent to a user to alert him of completion of order. 

If the summary data is from a one-time on-demand request and required 
immediately by a user, then a network appliance and data delivery method (configured 
by the user) is confirmed, and the data is rendered in the appropriate format for 

25 delivery and display in step 1 17. In step 119, the summary data is delivered according 
to protocol to a user's designated appliance. In step 121 a user receives requested 
information in the appropriate format. 

It will be apparent to one with skill in the art that there may be more or fewer 
logical steps as well as added sub-steps than are illustrated in this example. For 

30 example, step 105 may in other embodiments include sub-steps such as getting an 
encryption key from a user. In still another embodiment, part of a request may be 
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rendered as HTML as in step 113 while certain other portions of the same request data 
might be rendered in another format and delivered via alternative methods. There are 
many possibilities. 

The method and apparatus of the present invention may be used to present 
5 summaries to users without user input. Process logic such as this is detailed below. 

Fig. 6 is a logical flow chart illustrating an exemplary summarization process 
performed by the software agent of Fig. 4 in a User-independent smart mode with 
minimum or no user input. In step 1 17 an enterprise-initiated summary process 

10 begins. In this case, the enterprise may be assisting a user in finding a better deal or, 
perhaps presenting the individual with summaries from and links to alternative pages 
not yet subscribed to by a user. 

In step 1 19, a database containing user information and parameters is accessed 
and reviewed. Certain information specific to a user may be required to initiate an 

15 enterprise-sponsored summary report. At step 121, the knowledge worker accesses 
the site logic specific to the specified target site or sites for summarization. In step 
123, the knowledge worker modifies an existing user template, or creates a new one if 
necessary. At step 125 the template is stored in a repository such as repository 29 and 
associated with the user. 

20 As described in Fig. 5, the template either self-executes according to a timed 

function and invokes a browser control such as control 85 (Fig. 4), or is accessed by 
control 85 as a result of task notification. In step 127, the browser control begins 
navigation. Auto logins are performed, if required, in step 129 to gain access to 
selected sites. If the WEB pages are new to a user, and the user has no registration 

25 with the WEB site, then through agreement, or other convention, the service may be 
provided access to such sites. Such an agreement may be made, for example, if the 
host of the WEB site realizes a possibility of gaining a new customer if the customer 
likes the summary information presented. In many other situations, no password or 
login information is required to obtain general information that is not personal to a 

30 client. 
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In step 13 1, all sites are parsed for summary data and stored in canonical 
fashion in step 133. At step 135, the data is compiled and rendered as HTML for 
presentation on a summary page. In step 137, a WEB summary containing all of the 
data is made available to a user and the user is notified of its existence. 

5 Providing certain information not requested by a user may aid in enhancing a 

user's organization of is current business on the WEB. Moreover, unsolicited WEB 
summaries may provide better opportunities than the current options in the user's 
profile. Of course, assisting a user in this manner will require that the enterprise 
(service) have access to the user's profile and existing account and service 

10 information with various WEB sites on the user's list. A user may forbid use of a 
user's personal information, in which case, no enterprise-initiated summaries would 
be performed unless they are conducted strictly in an offer mode instead of a 
comparative mode. 



Enhanced Data Parsing and Logic Integration 

20 

In another aspect of the present invention, a software application is provided 
and adapted to recognize and parse data from semi-structured, WEB-based data 
sources on behalf of a user. 

Referring to Figs. 1-3 of application S/N 09/208,740, a portal system for 
25 interacting with WEB-based data is enabled by portal software 35 running on portal 
server 31 located, in this case, at ISP 15 of Fig. 1. Software 35 allows users who are 
connected to server 31 via Internet network connection, to access pre-configured 
URLs without requiring manual log-in procedures to be performed. 

Portal Interface 37 is an Interactive WEB page, which may be personalized to 
30 a specific user. In the example of Fig. 2, page 37 displays user-visited links and 

encrypted passwords to those links. Page 37 also provides software tools a user may 
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invoke to search for data either from his or her stored hyperlinks, or from specified 
fields within the pages defined by the hyperlinks. The example process of Fig. 3 
illustrates the above-described function. 

Figs. 4-6 of S/N 09/323,598 illustrate a method and apparatus for performing 
5 meta-summarization of WEB-based data on behalf of a user according to user request. 
Navigation to search the data is performed by proxy using what is termed a gatherer 
agent (software). Site-logic scripts are prepared by knowledge workers for navigation 
to the separate user sites. The scripts are typically Java-based executable routines 
combined with specific data descriptions and, if required, field location information 
10 provided by the user at the time of request. A user may request summary data from a 
plurality of sites and get the data returned on demand, or have it held by the system 
for later access. 

As previously described in the background section, field locations for data 
must be provided in order for the parsing engine to identify and return specified data 

15 in a structured arrangement. An input template provides instruction to the parser 
concerning what data to obtain for return. The template is created in part by user 
input through the portal interface and in part by knowledge worker providing data- 
navigation instruction, which may include field locations for structured data. 

The system partly relies on the fact that data requested by a user will appear at 

20 a same location (field) within a WEB page every time the system searches for it. The 
field location then becomes a critical part of finding the data. The inventor provides 
an enhancement to the WEB-summary system that allows the system to search for and 
parse data without the constraint of adhering to rigid data structures. Such a method 
and apparatus is described below. 

25 Fig. 7 is a block diagram illustrating a user-interactive set-up application 139 

according to an embodiment of the present invention. Application 139 is, in a 
preferred embodiment, a graphical tool provided to users and accessible through their 
respective portal pages. A user invokes application 139 when he or she desires to pre- 
configure profiled data sources for meta-summarization. In a preferred embodiment, 

30 activation of application 139 causes an interactive browser window to open within a 
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user's portal page. By working within the window, a user may pre-configure sites for 
data acquisition. 

Application 139 comprises an initialization layer 141 adapted for user 
interface, and a document type definition (DTD) generation layer 143 adapted to 

5 generate DTDs, which describe selected data sources. Initialization layer 141 has a 
browser control module 145 provided therein and adapted as a browser extension for 
navigation to selected URLs. Application 139 may be integrated with a user's 
browser application such that the presented window of application 139 is a browser 
window as described above. A user-data interface 147 is provided within layer 141 

10 and adapted as a data-input field for entering URLs for navigation purposes. By 
entering a URL into interface 147, browser control module 145 causes navigation to 
and presentation of the WEB page defined by the entered URL. 

Presentation of the selected WEB page is conducted utilizing the well-known 
multi-window technology such that the WEB page may be displayed within the 

15 window of application 139 while leaving other controls attributed to application 139 
visible and accessible to a user. One such control is a block selection module 149, 
which is adapted as a user-controlled highlighter for selecting specific parts of a WEB 
page containing data that is desired by the user to be accessed. Module 149 may 
function by combination of keyboard manipulation and mouse click similar to well- 

20 known text selection tools available in word applications. 

A selection-submission module 151 is provided within layer 141 and 
implemented to allow a user to submit selected portions of a WEB page to the portal 
system for DTD generation. Highlighting or blocking a section of a WEB page 
defines the boundaries for data search. A user must also specify the type of data to be 

25 extracted from the highlighted area of the WEB page. 

In practice a user may call-up many WEB pages, highlight (define) sections of 
each page, and provide data descriptions for data extraction with regard to each page 
all in one session with application 139. The method described above comprises a 
meta-data request wherein the returned results are aggregated and displayed to, or 

30 otherwise made available to users according to enterprise rules. The output of layer 
141 is a highlighted portion of a "structure tree" describing the HTML data structure 
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used to display the data on the target WEB site along with associated data-type 
descriptions input by a user. 

A data structure tree defines how data is displayed on a WEB page in HTML 
format. An application program interface (API), which is part of the normal browser 

5 function understands the HTML data structure used in the construction of a WEB 
page, which is available at the source. Therefore, a specific structure tree is captured 
by browser module 145 every time an associated WEB page is displayed in 
application window 139. User-highlighted portions of a WEB page define "portions" 
of the overall data structure tree of that page. Therefore, the output of layer 141 

10 comprises an entire data structure tree for a WEB page, a highlighted portion of that 
data structure, and a description of the type of human-readable data to be extracted 
from that portion of the tree. 

Layer 143 is responsible for producing DTDs adapted to facilitate data search 
and extraction. A DTD generator is provided within layer 143 and adapted to 

15 generate a DTD of a data source using information supplied by layer 141. A DTD is a 
template written in a language such as XML that is understood by a browser/data- 
parsing application. In a preferred embodiment a DTD is created in Extensible 
Markup Language (XML), however, any standard script language may be employed 
such as Standard Generalized Markup Language (SGML). A DTD is generated for 

20 each portion of a WEB page a user highlights. 

A database interface module 155 is provided within layer 143 and adapted to 
allow interface to a connected database for the purpose of obtaining site-logic scripts 
for navigation, which include log-in blocks for performing automated log-in function 
for sites requiring passwords. In some cases new site-logic scripts are required if data 

25 is to be extracted from a new page. Interface 155 may also be used to obtain any other 
useful information. 

A DTD/site-logic integration module 157 is provided within layer 143 and 
adapted to create a routine combining site logic and DTD templates in such a way that 
navigation and data extraction is performed seamlessly and automatically. For 

30 example, a site logic script with a log-in block is used to navigate to and access a 

particular URL, then a DTD template portion reveals where on that URL page to look 
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for data and what type of data to extract from the URL page. Information gathering 
for a next URL would follow a next site-logic and DTD instruction contained in the 
routine and marked for that URL and so on. An automated navigation and data 
extraction routine may facilitate a plurality of URLs included in one data search 
5 execution. 

It is conceivable that one routine containing the required instruction blocks 
could liacilitate automated navigation and information retrieval from a great many 
URLs during one automated routine on behalf of a user. A single WEB site or a 
combination of, or all of a user's WEB sites may be processed for data during a single 

10 automated process. All that is required of a user is to first set-up a URL or URLs for 
data searching by navigating to them, highlighting portions contained therein, and 
providing a description of the type of data to be extracted. Once set-up, summary data 
from the affected URL pages may be periodically gathered on behalf of the user and 
presented in a variety of ways, some of which are described in disclosure pertaining to 

15 S/N 09/208,740 and S/N 09/323,598. 

It will be apparent to one with skill in the art that application 139 as 
exemplified above is provided to execute as a network-supported application on a 
client. In this example, layer 141 is provided to execute as a client-side application 
while layer 143 is provided and executed at server side. Communication and 

20 cooperation between layers 141 and 143 is achieved through appropriate network- 
interface technologies known in the art. Proxy navigating and data gathering is 
executed at the server side on behalf of a user. In one embodiment all of the function 
of application 139 may be provided at the client's side. In another, all of the function 
may be applied on the server side, in which case a knowledge worker associated with 

25 the server may initialize the sites for search. 

It will also be apparent to one with skill in the art that other modules 
responsible for added function may, if desired, be provided within application 139 
without departing from the spirit and scope of the present invention. For example, a 
module for sectoring a pre-configured data search and scheduling each sector for 

30 execution may be provided within layer 141. In this case, a user may schedule 
alternate data searches of separate groups of URLs. Other lesser controls (not 
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illustrated) may also be provided such as edit controls, clear selection, cancel search, 
and so on. There are many possibilities. The inventor intends that application 139 
represent just one simple implementation out of many possible alternative 
implementations. 

5 Fig. 8 is a block diagram illustrating intelligent navigation and parsing 

capability according to an embodiment of the present invention. A navigation/parsing 
application 159 is provided for the purpose of navigating to and parsing data from 
WEB-based data sources on behalf of a user. Application 159 may be considered 
somewhat analogous to the "gathering agent" described in S/N 09/323/598. 

10 Application 159 is responsible for navigating to selected URLs and extracting data 
from them for return to users. Enhanced capability provided in part by enhanced 
input data for navigation and in part by built-in intelligence enables application 159 to 
operate more intelligently and in a more streamlined maimer with respect to workload. 
Input to application 159 comprises DTD data and site-logic data interwoven 

15 into an instruction routine that provides instruction for navigation, log-in (if required), 
and data parsing. A directional arrow labeled DTD/Site-logic illustrates data input. A 
navigation and parsing sequence 161 is executed based on input data instruction. 
Parsing intelligence is enhanced by virtue of data reference libraries 163 and 165. 
Library 163 is responsible for enabling text matches and associations. 

20 Library 163 is flexible such that a parsed word may be associated with a 

variety of similar words or phrases. For example, if data is being parsed from an 
investment site quoting stock prices, then the appearance of the word portfolio may be 
equated with not only the exact word, but also with a similar word or phrases known 
to equate with the word such as "stock portfolio", "current portfolio", "view 

25 portfolio", and so on. This enables a user to approximate the description of the type 
of data that is extracted from a highlighted portion of a WEB page. Moreover, if a 
WEB master changes the description of the data between searches, an intelligent 
parser will still be able to find the data through word and phrase association 
techniques. 

30 Library 165 contains examples of style variations that may be used in the 

presentation of data on a WEB page. Library 165 enables the parser to understand 
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data presented in a variety of styles such as italic, bold, underlined, small fonts, larger 
fonts, text formats, font styles, and so on. In this way, a parser may still find the 
requested data even if a WEB master changes the style or format of presentation 
between data searches. 
5 In one embodiment of the present invention, successful request histories may 

be compiled and used to enhance parsing and data return. Parsing is, in this example, 
restricted to a highlighted portion or portions of a WEB page, wherein the requested 
data presumably resides. Because of this, it is likely that only a few differing types of 
information will be available in the highlighted portion of a WEB page. Therefore, 

10 past request records may be used in an attempt to eliminate or confirm a data type 
residing in a highlighted section under consideration. This embodiment assumes that 
a current request for data does not register any matching words or phrases contained 
in the data type or in parsing intelligence. 

To further illustrate, assume that there are two different data types available in 

15 a highlighted portion of a WEB page. If the page is a banking page, one of the data 
sets may be a list of available loans and current interest rates. The other data set 
included in the section may be a list of most recent savings account deposits and 
withdraws. By parsing all of the data in the section, and comparing the data to a 
previous (successful) routine, it may be determined which type of data was previously 

20 returned. By comparing the previous natural language request to the current one, it 
may be determined if the requests are similar in nature. If a previous request read 
"return available loan options and current rates" it can be determined that the loan 
data did match that request. If a current non-registering request reads "send me my 
balance", it may be determined that the current request does not register with the 

25 system, but it is also not analogous to the previous successful request. Therefore, the 
data set corresponding to the request for loan information is discarded and the 
remaining data is returned including the account information. 

The above example serves to illustrate adaptive intelligence that is provided to 
navigation and parsing sequence 161. It is assumed herein that a user will only select 

30 portions of a WEB page where desired data resides. Therefore, it is likely in many 
cases that one or only a few types of data will be included in a selected portion. This 
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fact makes it easier to determine what data will be returned to a user. It is also noted 
here that all of the data from a selected portion of a WEB page is retrieved from a 
source. Parsing of the data after it is retrieved determines which data will be returned 
to a user. Data that does not fit a request for that section is discarded. In one 

5 embodiment of the present invention, all data from a section is returned by default if a 
request cannot be matched to specific data in the section. 

In still another embodiment, a WEB master may change the location of data on 
a WEB page between routine data searches such that it is moved out of a user's 
highlighted section of the page. In this case, a routine could be performed to find the 

10 moved data if the WEB master has retained the data structure. To accomplish this, the 
system compares the old highlighted structure with the new structure of the WEB 
page and matches the structures. If the data contained in the new section matches the 
current request, then a correction is made. 

Application 159 may be executed to navigate to and gather data from a single 

15 data source or from multiple data sources depending on pre-configuration. 

Conceivably, there is no limit to the number of URLs that may be included in one 
executed routine. 

In still another embodiment, application 159 may be enhanced with additional 
enterprise rules to allow for even more intelligent parsing capability. For example, in 

20 addition to data reference libraries 163 and 165, which provide intelligence regarding 
text and style variations, an additional rules base may be provided for allowing system 
161 to determine logical application of certain data-types that are parsed. 

In some instances, data requested by a user may include time dependent data 
that may change or otherwise may not be valid after a certain period of time or date. 

25 One good example of this would be if a user requests all ongoing chat events from a 
plurality of separate chat sites wherein the events fall under a general topic or field of 
entertainment. Application 159 would navigate as previously described, and system 
161 would parse the available chat titles at each site. An additional step would 
eliminate all chat-event titles or event fields that do not closely match the request thus 

30 narrowing the field. A subsequent step would eliminate all remaining events that are 
almost over. A next step may eliminate all remaining events that are marked for 
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gender or age participation other than what is known about the requester. Ultimately, 
the field is narrowed to those events that match the request, have agreeable 
participation requirements for the requester, and have sufficient time left in session for 
optimum participation. As a final step, the top 10 or so qualifying events may be 
5 selected for the requester based on number of participants etc. 

The above method may be applied to any type of timed live event presented on 
the Internet. Live concerts, live video presentations, live radio shows, and many other 
types of WEB-events may be included. Rules governing such events may be 
compiled and made a part of user profile information and a rules base added to 

10 application 159 may be retrieved from that information and therefore will be 
individual to a requester. There are many possibilities. 

Fig. 9 is a flow chart illustrating a semi-structured data retrieval process 
according to an embodiment of the present invention. In step 167 a user logs into his 
or her personal portal page. Typically, a user name and password is required during 

15 step 167 for authentication purposes, although in some cases the log-in may be 
automatic. At step 169 the user invokes application 139, which is presented as an 
interactive tool along with other functions in the portal page. Application 139 is used 
to pre-configure URLs for data search and return as was previously described. During 
this step, application 139 opens a browser window for navigation. It is important to 

20 note here that in a preferred embodiment, a user pre-configures each WEB page while 
on-line and navigating to each page. However, this is not required to practice the 
present invention. In one embodiment, a user may work off-line if he or she has all of 
the WEB pages cached in their presentable form. 

At step 171, a user navigates to a desired URL for purposes of highlighting 

25 sections of the page for data retrieval. At step 173, the entered URL is displayed in 
the open window. Using a provided selection tool, a user then highlights a desired 
section or sections of a displayed WEB page at step 175. A user may highlight one or 
more sections of a same page. Moreover, one highlighted section may contain one or 
more sets of data a user wishes to retrieve. During step 175, a user also types in a data 

30 description concerning what type of data is to be returned from the highlighted portion 
of the page. If only one type of data exists in the highlighted section, then a 
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description may nqt be necessary. It is noted herein that a user will likely highlight a 
section larger than a portion just containing the desired data in case the data is moved 
slightly within a same WEB page between data searches. 

At step 177 a user submits his or her selection and request entries to a server 

5 application responsible for further processing. Layer 143 of Fig. 7 represents the 
above mentioned server application. In this step, a user may configure many URL 
sites and data requests associated with the sites and submit all of the information 
collectively by one action. 

At step 179, a DTD is generated for each highlighted portion of each URL. 

10 DTDs provide instruction to the parsing application as previously described in Fig. 7. 
At step 181, DTDs are organized and integrated with applicable site-logic including 
any log-in instructions required to access WEB sites. The result of this integration is 
an executable routine and instruction template for the navigation and data-gathering 
system taught in disclosure above. After a user submits all of the required data in step 

15 177, the process is entirely automated. 

At step 183, it is determined whether data results are requested immediately 
(on demand) or whether they are directed to be held for a user for later access. If a 
user requests immediate data return, then a browser control immediately executes 
according to generated instruction at step 191 . A user may configure and request data 

20 from one URL at a time and receive data while still engaged in requesting data from a 
next page so as to operate in an active session of requesting and receiving data. 
However, typical implementation will be to pre-configure and request data from a 
series of URLs and schedule the data return for a later time. 

At step 193, data is gathered and results are returned according to completed 

25 instruction. At step 195 a user receives the resulting data as it becomes available. It 
is noted herein that a user may practice an active session of immediate data return 
upon configuration and data request submissions. It is also noted herein that a user 
may complete a configuration and request submission process, and set-up a periodic 
time-table for the process to execute. The latter is the more likely and more useful 

30 scenario. 



ft 
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If it is directed that a user have his or her data results held for later access, then 
at step 185 a browser control is invoked for execution of the request. At step 185 data 
is found and parsed according to instruction. At step 189, data results are aggregated 
and held for a requesting user. Activation of the data-gathering and return process 
5 may be delayed according to schedule with periodically scheduled return of results. 
It will be apparent to one with skill in the art that the interactive process 
described herein may be altered to accommodate a number of different user 
preferences without departing from the spirit and scope of the present invention. For 
example, a user may pre-configure separate groups of URLs for data retrieval and 

10 cause separate processes to operate according to user selected time periods. For 

example, a user may wish to have all of his or her account information delivered on a 
certain day each week while he or she gets a news headline summary daily. There are 
many possibilities. The inventor intends that this process example represent just one 
of many possible orders for practicing the present invention. 

15 The method and apparatus also may be practiced in a language and platform 

independent manner, and be implemented over a variety of scaleable server 
architectures. 

The method and apparatus of the present invention may be practiced via 
private individuals on the Internet, businesses operating on a WAN connected to the 
20 Internet, businesses operating via private WAN, and so on. There are many 

customizable situations. The present invention as taught herein and above should be 
afforded the broadest of scope. The spirit and scope of the present invention is limited 
only by the claims that follow. 
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What is claimed is: 

1. A configurable Internet WEB search system, comprising: 

a browser module for navigating to and displaying a WEB page; 
5 a block selection and configuration function having input tools for a user to 

select at least one block portion of a displayed WEB page for data retrieval; 

a data-type input function for a user to denote data type to be extracted from a 
selected block portion; and 

a search implementation function for implementing a search under the search 

10 system; 

characterized in that the data type entered by the data input function is 
associated with a WEB page block selected, and upon search implementation the 
block selected is searched for the data type requested, and data found is retrieved to be 
provided to the user. 

15 

2. The search system of claim 1 wherein block selection is by click and drag 
techniques as used in blocking text for a word processor. 

3. The search system of claim 1 wherein data types are entered as natural language 
20 strings. 

4. The search system of claim 1 wherein multiple blocks may be selected and a data- 
type associated with each selected block. 

25 5. The search system of claim 1 wherein search implementation is initiated as each 
data block is selected and a data-type is associated with the selected data block, and 
matched data is immediately retrieved and transmitted to the user. 



6. The search system of claim 1 wherein matched data is retrieved and accumulated 
30 for a user until the user requests transmission of the accumulated data. 
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7. The search system of claim 1 wherein the search system is implemented between a 
user station and an Internet Portal server, the block selection and configuration 
function and the data-type input function executing on the user station, and navigation 
and data retrieval functions are executed by the Portal server. 

5 

8. The search system of claim 1 wherein the user operates through a portal server to 
access and configure WEB pages, and the block selection and data-type association 
functions generate a data-type definition (DTD) file associated with the WEB page 
listing the selected blocks and associated data types for the page. 

10 

9. The search system of claim 8 wherein the user has a home page on the portal server 
listing URLs visited regularly by the user, and wherein the system saves the DTD files 
created by the user for the user's regularly visited pages in a manner that the search 
system may be initiated by the user for selected pages from the home page, and when 

15 initiated, searches the selected pages according to the stored DTD for each page. 

10. A method for searching WEB pages by a user for specific data, comprising steps 
of: 

(a) navigating to a WEB page by the user via a browser function; 
20 (b) selecting a specific block of the WEB page by the user using a block 

selection and configuration function having input tools for a user to select at least one 
block portion of a displayed WEB page for data retrieval; 

(c) inputting a data type to be associated with a selected block using a data- 
type input function; 
25 (d) initiating a search; and 

(e) retrieving information from the data block according to the data type input. 

1 1. The method of claim 10 wherein, in step (b), block selection is by click and drag 
techniques as used in blocking text for a word processor. 

30 
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12. The method of claim 10 wherein, in step (c), data types are entered as natural 
language strings. 

13. The method of claim 10 wherein, in steps (b) and (c), multiple blocks may be 
5 selected and a data-type associated with each selected block. 

14. The method of claim 10 wherein, in step (d), search implementation is initiated as 
each data block is selected and a data-type is associated with the selected data block, 
and matched data is immediately retrieved and transmitted to the user. 

10 

15. The method of claim 10 wherein matched data is retrieved and accumulated for a 
user until the user requests transmission of the accumulated data. 

16. The method of claim 10 wherein the search system is implemented between a 
15 user station and an Internet Portal server, the block selection and configuration 

function and the data-type input function executing on the user station, and navigation 
and data retrieval functions are executed by the Portal server. 

17. The method of claim 1 wherein the user operates through a portal server to access 
20 and configure WEB pages, and the block selection and data-type association functions 

generate a data-type definition (DTD) file associated with the WEB page listing the 
selected blocks and associated data types for the page. 

18. The method of claim 17 wherein the user has a home page on the portal server 

25 listing URLs visited regularly by the user, and wherein the system saves the DTD files 
created by the user for the user's regularly visited pages in a manner that the search 
system may be initiated by the user for selected pages from the home page, and when 
initiated, searches the selected pages according to the stored DTD for each page. 
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